Entropy production as correlation between system and reservoir 
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We derive an exact (classical and quantum) expression for the entropy production of a finite 
system placed in contact with one or several finite reservoirs each of which is initially described 
by a canonical equilibrium distribution. Whereas the total entropy of system plus reservoirs is 
conserved, we show that the system entropy production is always positive and is a direct measure of 
the system-reservoir correlations and/or entanglements. Using an exactly solvable quantum model, 
we illustrate our novel interpretation of the Second Law in a microscopically reversible finite-size 
setting, with strong coupling between system and reservoirs. With this model, we also explicitly 
show the approach of our exact formulation to the standard description of irreversibility in the limit 
of a large reservoir. 
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Starting with the groundbreaking work of Boltzmann, 
there have been numerous attempts to construct a micro- 
scopic derivation of the Second Law. The main difficulty 
is that the prime microscopic candidate for the entropy, 
namely, the von Neumann entropy S — — Trplnp with p 
the density matrix of the total or compound system, is 
a constant in time by virtue of Liouville's theorem. Re- 
lated difficulties are the time-reversibility of the micro- 
scopic laws and the recurrences of the micro-states. A 
common way to bypass these difficulties is to introduce 
irreversibility in an ad hoc way, for example by reason- 
ing that the system is in contact with idealized infinitely 
large heat reservoirs. Nevertheless, as was realized early 
on by Onsager, a consistent description of the resulting 
irreversible behavior still carries the undiluted imprint 
of the underlying time-reversibility and Liouville's theo- 
rem for the system. Examples are the symmetry of the 
Onsager coefficients and the ftuctuation dissipation the- 
orem. As examples of more recent discussions we cite re- 
sults on work theorems and fluctuation theorems [l|, 0, [3] ■ 
Even more relevant to the question pursued here, we cite 
the microscopic expression for the entropy production 
as the breaking, in a statistical sense, of the arrow of 
time 0, i, S, 0, B H [T^. We also mention that signif- 
icant effort has been devoted to a detailed description 
and understanding of the interaction with the heat reser- 
voirs, in particular the difficulties of dealing with the case 
of strong coupling [ll. 12|. 



In this letter we show that the problem of entropy pro- 
duction can be addressed within a microscopically exact 
description of a finite system, without resorting to in- 
finitely large heat reservoirs and without any assumption 
of weak coupling. Whereas the von Neumann entropy 
of system plus reservoirs is conserved, the entropy pro- 
duction of the system is always positive, even though it 



displays oscillations and recurrences typical of the finite 
total system. Interestingly, this entropy production is ex- 
pressed in terms of the correlations and/or entanglement 
between system and reservoirs, so that its positivity can 
be explained by a corresponding negative entropy con- 
tribution contained in the correlations and/or entangle- 
ment with the reservoirs. As the size of the reservoirs 
increases, the recurrences die out, the negative entropy 
contribution is diluted in an intricate way over the in- 
creasing number of correlations with reservoir degrees of 
freedom, and the entropy production of the system it- 
self approaches the standard thermodynamic form. We 
will illustrate this novel interpretation of the Second Law 
on an exactly solvable model, namely, a spin interacting 
with an A^-level quantum system via a random matrix 
coupling. We focus on the derivation for the quantum 
case, but the analogous treatment for the classical sys- 
tem is straightforward. 

The set-up is as follows. We consider one or several 
finite quantum systems r which play the role of finite- 
size heat reservoirs. Accordingly, their density matrices 
Pr{t) at the initial time t = are assumed to be of the 
canonical equilibrium form. 
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Here j3r, and Z,. are the corresponding inverse temper- 
ature at i = (Boltzmann's constant fcs is set equal to 
1), the Hamiltonian, and the partition function aX t = Q. 
Being reservoir systems, it is further natural to assume 
that their Hamiltonians are time-independent. At 
time t — Q we connect a finite quantum system s, char- 
acterized by Hamiltonian Hs{t) and density matrix Psit), 
to the reservoirs by switching on an interaction Hamil- 
tonian V{t). The initial state of the compound system, 
characterized by the density matrix p(t), does not display 
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any entanglement or correlation, 

p(o)=p.(o)np^ (2) 

r 

Correlations and/or entanglements do develop in the sub- 
sequent time evolution of p{t), which obeys Liouville's 
equation for the total Hamiltonian 

Hit) ^ Hsit)+J2Hr + V{t). (3) 

r 

Note that in addition to the issue of relaxation of a sys- 
tem in contact with a reservoir, this scenario includes the 
ingredients for the study a driven system, cf. the time- 
dependence of the system's Hamiltonian, as well as that 
of a noncquilibrium steady state, which can be realized 
in view of the presence of several heat reservoirs. In fact, 
the above construct can easily be generalized to include 
particle reservoirs described via grand-canonical distri- 
butions. This would allow the consideration of particle 
flows in addition to heat flows. 

We are primarily interested in the occurrence and char- 
acterization of irreversible behavior in the system, and 
we thus focus our attention on the entropy S{t) of the 
system, 

S{t) = -TT,p,it)liip,it) (4) 

where Ps{t) is the trace of p{t) over the degree of freedom 
of all the reservoirs. Contrary to the total von Neumann 
entropy, the entropy of the system is in general a func- 
tion of time, technically speaking because the dynamics 
of ps (t) is not unitary. More to the point for the ensuing 
discussion, we note that from the thermodynamic point 
of view we are dealing with an energetically open system. 
We now show that it is precisely the time invariance of 
the total von Neumann entropy which induces a natural 
separation of the entropy change of the system into sep- 
arate contributions from an entropy flow and an entropy 
production. Using -Tv p{t) In p{t) = -Trp(O) Inp(O) = 
-Tr,p,(0)lnp,(0) - X;^Tr^Pr''lnp°<i, we find for the en- 
tropy change of the system 

AS{t) = S{t) - S{0) 

= -Trp(t) In Ps (t) + Trp(t) In p(t) - ^ Tr.p^^ In p^'i 

r 

= -Trp(t) ln{ps it) II p';^} + Trp(t) In pit) 

r 

+ 5]Tr,[p,(t)-p::'i]lnp5;i. (5) 

r 

We conclude that the change in the entropy of the system 
can be written in the standard thermodynamic form [l3| 

ASit)^ A,Sit) + AeSit). (6) 

The entropy flow, representing the reversible contribu- 
tion to the system entropy change due to heat exchanges. 



is identified as the last term in ([5|). After some manip- 
ulation using the explicit form of p^^i, it can be written 
as 

A,Sit)^-J2M{Hr)t~{Hr)o), (7) 

r 

where (•)( = Tr[p(t)»]. Of particular interest is the re- 
sulting expression for the entropy production, 

AMt)^D[pit)\\psit)l[p'i,% (8) 
r 

which represents the irreversible contribution to the en- 
tropy change of the system. Here, D[p\ \p'] is the quantum 
relative entropy between two density matrices p and p' , 

D[p\\p'] = Trplnp- Trplnp'. (9) 

It has the following important properties [i3, [H. The 
relative entropy is positive, and equal to zero only when 
the two matrices are identical. We thus conclude that the 
entropy production introduced above is indeed a positive 
quantity, AiSit) > 0, and vanishes only when the system 
and the reservoirs are totally decorrelated. Furthermore, 
the relative entropy is a measure of the "distance" be- 
tween two density matrices. Hence, as announced earlier, 
the entropy production explicitly expresses how "far" the 
actual state pit) of the total system is from the decorre- 
lated/disentangled product state psit) Pr'^- 

To further clarify the significance of our central result 
([6|), we make a number of additional comments. First, 
starting with Eq. ([6]) we can rewrite the entropy pro- 
duction as AiSit) = ASit) - AeSit). AS'(t) is the ex- 
act entropy change of the system. If one assumes that 
the entropy change in each heat reservoir is given by 
ASrit) = —PrQr{t), and if one further erroneously sup- 
poses that the total entropy is simply the sum of the sys- 
tem and reservoir entropy, one concludes that the positive 
entropy production AiSit) is the entropy increase in the 
total system. This is of course in flagrant contradiction 
with the premise that led to the identification of AiSit), 
namely, that the entropy of the total system remains un- 
changed. The error resides in disregarding a contribution 
—AiSit) to the total entropy, which is precisely the neg- 
ative entropy contribution contained in the correlations 
and entanglement between system and reservoir. The 
argument may on the surface appear circular, but the 
neglect of the negative entropy contribution is actually 
quite natural from an operational point of view: while 
one has full microscopic access to the system's proper- 
ties, one only controls or measures the energy and no 
other properties of the reservoir. In this sense, the above 
procedure leading to an apparent total positive entropy 
change can be viewed as a coarse graining operation that 
retains the full microscopic description of the system but 
reduces the reservoirs plus correlations to an idealized 
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heat reservoir description. In the hmit of large reser- 
voirs it is likely that this latter description deviates very 
little from the canonical distribution. Concerning the 
correlations, one expects that they will be diluted over 
the exponentially many higher-order correlations, becom- 
ing in effect irretrievable. Furthermore, this will happen 
exponentially fast in time if the reservoirs display non- 
integrable, chaotic properties. 

Second, while AiS{t) is a positive quantity, it does not 
increase monotonically in time. In fact, oscillations are 
bound to arise in view of the recurrences in the state of 
the finite total system. In this respect, it is important 
to stress that we consider the entropy change starting 
from the natural but specific initial condition ([2|). The 
transient decreases of AiS{t) can be interpreted as the 
reappearance of the negative entropy, hidden in the cor- 
relations, as system and reservoir transiently return to 
states close to this decoupled initial state. In the limit 
of large reservoirs, recurrences will become less and less 
likely, and AiS{t) is expected to converge to a convex 
monotonically increasing function of t. 

Third, we make the connection with a recent discussion 
[lll.[T3| concerning the appropriate definition of work and 
free energy in a driven system strongly coupled to a heat 
reservoir. We consider the case of a single reservoir at 
temperature T = f3~^, for convenience dropping the sub- 
script r. Using the fact that TrH{t)p{t) = 0, the work 
done on the total system can be written as 

W EE {H{t))t - {H{0))o 



dTTv{Hs{t) + V{t))p{t). (10) 



The change of the energy of the system, including the 
contribution of the interaction term, reads 

AUit) EE {{Hs{t) + V{t))), - {{HM + V{0)))o. (11) 

Using Tr{Hs{t) + V{t))p{t) = -TiHrp{t), we find that 
this energy change can be written, in accordance with 
the First Law, as the sum of work and heat, 

AU{t) = W{t)+Q{t). (12) 

Next, introducing the nonequilibrium free energy 

AF{t)EEAU{t)-TAS{t), (13) 

we can rewrite the expression (|6]) for the entropy produc- 
tion in the standard thermodynamic form for a driven 
system in contact with a heat reservoir. 



TA,S{t) = W{t) ~ AF{t) > 0. 



(14) 



This expression is exact. If we assume that the total 
system relaxes to a final canonical equilibrium at tem- 
perature this nonequilibrium free energy difference 
reduces to the equilibrium expression identified in the 



context of the work theorem in both the weak coupling 
0, 0, [l3| and strong coupling regimes 11, 1^. 

Finally, we discuss the connection with the following 
alternative definition for the irreversible entropy change, 
proposed in open quantum system theory [isj : 



XS{t) EE D[pMM'']'D[pAt)M''] 

= AS{t)- AeS{t). 



(15) 



The entropy flow is now deflned as AeS{t) = P{{Hs)t — 
{Hs)o) and p'p — exp {—l3Hs)/Zs- To compare this ex- 
pression with our definition ([5]) for the entropy produc- 
tion, we note that total energy is conserved by the dy- 
namics, {H)t = {H)o, and hence 



XS{t) = A,S{t) ~ l3{{V)t - (U)o) > 0. 



(16) 



The two definitions thus differ by the interaction term, 
which vanishes in the limit of cither weak coupling or 
high temperature. The definition (fT5|) has the obvious 
advantage of being exclusively expressed in terms of the 
system density matrix, while our definition ([5]) requires 
the total density matrix. However, we will show that 
contrary to our expression, (|15[) is not always a positive 
quantity. The positivity of (|15p can be proven when p^'^ 
is the stationary solution of the reduced dynamics [l5|. 
This will generically be the case in the weak-interaction 
large-reservoir limit, i.e., precisely when the interaction 
term in (fT6)) can be neglected and becomes identical 
to ([8]). An even stronger statement can be made when, 
in the same limit, the system dynamics can be described 
by a Markovian quantum master equation of the form 
Psit) = Cps{t), where £ is a Redfield superoperator sat- 
isfying Cpf^ = 1^, 17 1 . Under these conditions, it is 
known that the entropy production is a convex functional 
of the system density matrix [l3| , with a positive rate of 
entropy production j-^AiS{t) « j-^AiS{t) > 0. 

We will now illustrate the above findings in a two- 
level quantum spin coupled to an A^-level reservoir via 
a random matrix. The total Hamiltonian reads 



H 



A 



(17) 



(Tj. 2 are the well known Pauli matrices. The reservoir 
Hamiltonian is a diagonal matrix with N equally 
spaced eigenvalues between —0.5 and 0.5. The couphng 
matrix is i? = X/^/SN, where X is a Gaussian orthog- 
onal random matrix of size N with probability density 
proportional to exp(— |;TrX^) [3]. This model is sim- 
ilar to the spin-GORM model of Ref. [l3|. The sys- 
tem is initially assumed to be in the pure lower energy 
state Ps{0) = |0)(0|, where crz|0) — — 10), and the reser- 
voir is initially in a canonical equilibrium state at the 
temperature In the weak-coupling large-reservoir 

limit, the resulting Redfield equation leads to the follow- 
ing closed relaxation equation for the z-component of the 
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spin {h = 1): 



7 = 2nX^{&{A) +a(-A)) 
, , a(~A)-5(A) 



a(-A) +a(A)' 



(18) 



Here a(w) is the Fourier transform of the reservoir corre- 
lation function a{t) = TirP^^ exp [iHrt\Rexp [—iHrt\R, 



1 e-/3/2e/3|"l 



16 



-0/2 g/3/2 



5(-|c.|). (19) 



The X and y components of the spin evolve independently 
of the z component, and are zero for our initial condition. 




FIG. 1: (Color online) ASi [resp. ASi] is the entropy produc- 
tion ((Sj [ (|15p ] calculated using the exact numerical dynam- 
ics. A5i(QME) is the irreversible entropy production (llSp 
calculated using the Redfield equation (|18|l . Parameters are 
A = 0.1, /? = 10, A = 0.1. 

We are now in a position to compare the definition 
(fT5| of the entropy change with the irreversible entropy 
change ^ that follows from Redfield theory. This is ac- 
complished through an exact numerical solution of our 
model for finite N. The results are summarized in Fig. 
[TJ Note that we show single realizations of the random 
matrix. For small N, we observe a pronounced oscil- 
latory behavior and even near-recurrences very close to 
zero of our entropy change ([5]). While the latter always 
remains positive, the entropy change psp can be negative 
for small values of N, which is clearly not acceptable. In 
the limit of a large reservoir (N — > oo ) , both expressions 
converge to one another and coincide with the positive 
and convex irreversible entropy change predicted by the 
Redfield equation. 

We conclude that ([H]) is a proper definition for the en- 
tropy change, one that remains valid for a small system 
strongly coupled to small reservoirs. In the limit of large 
reservoirs, it converges to a convex irreversible entropy, 
coinciding with the familiar definition of entropy produc- 
tion [l5| for the quantum master equation. Our identi- 
fication of the entropy production ([5]) within an exact 



microscopic framework vindicates the description of ir- 
reversibility as a property of open systems, with the en- 
tropy production rather than the entropy of the total 
system playing the central role. The microscopic origin 
of the entropy production, explained in terms of correla- 
tions established between the system and its reservoirs, 
is reminiscent of Boltzmann's Stosszahlansatz. However, 
our analysis of the micro-dynamics and the identifica- 
tion of the entropy production of the system are exact. 
The appearance of irreversibility as the omission, in the 
reservoirs, of its correlations with the system, provides 
a natural, precise and transparent interpretation of the 
Second Law. 
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